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Method of and appnrn ms for mnnipularing dimtai data wnrif <; 



Field of the invention 

This invention relates to a method of and apparanis for manipulating digital data works, 
particularly to provide, or embed withm, such digital data works, data descriptive of the 
work, for example, the source of the work, its ownership and its availability for legal 
reproduction without infringement of copyright. 



Description of the Prior An 

Systems based upon digital data are becoming universal and indispensable; digital data 
passing between computers; digital telecommunications; digital audio: digital cameras- 
and the convergence of many of these individual components into mulri-media. are a 
selection of the technologies to which this invention relates. The data structures or 
formats that are used in these different technologies are well documented and will not 
be described in this specification. It will however be appreciated by the skilled 
implementer that sophisticated encoding and compression algorithms are commonly 
used in digital recording and transmission and that these techniques may involve the 
manipulation of raw digital data in order for that data to carry funher information. 
However, the funher information introduced in such known techniques provides data 
needed to understand or handle, for example, bytes of the raw data property. 

The present invention is not directed to manipulating small units of digital data to enable 
that data to cany information inherent to the proper comprehension of the digital data 
itself but instead to hiding within a digital data work information that is specificallv 
descriptive of that particular digital data work. The term digital data work defines any 
sequence of digital data capable of constimting a work in which copyright might subsist 
or the unauthorised reproduction of which might constitute infringement of any 
copyright subsisting in the work or a larger work of which the woric itself forms a pan. 
Hence, for example, the digital data defining the output from scanning a 35mm colour 
transparency would be a digital data work. 

There is a pressing need to enable the ownership of a digital data work to be readilv 
apparent from the work itself. This would allow the owner of the copyright in the work 
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to prove more readily its ownership and thereby prevent funher unlawful reproduction 
or negotiate a licence fee for use of the work. Also, it would enable a publisher of 
digital data works, for example a company that compiles multi-media CD-ROMS, to 
ensure that it is not unwittingly infringing copynght. Conventionally, this requires 
laborious and meticulous manual recording of the provenance of third pany digital data 
works that are to be used. This is time consuming, expensive and not whoUy reliable. 

As a more specific example, consider a professional photographer Who uses a digital 
camera to take a digital photograph. He may wish to place the data file which 
constitutes the digital data work (the digitised photograph) with a photograph library. 
When the photograph is subsequently used, the photographer will be paid a copvpiaht 
licence fee. However, the ease with which the data file can be duplicated without any 
loss of information means that the funher use of the image can be impossible to control. 
In practice, there is a high probability that the image could be published again without 
15 the photographer being alened to the fact; the photographer then losses out on licence 
fees. The ease with which digital images can be cropped and modified compounds the 
problem. 



10 



20 



25 



30 



Currently, it is possible to include a simple identifier in the header of the data file of a 
digital data work. The header could typically comprise a simple copyright notice. 
However, it is very easy to strip out diis information, making this approach unreliable. 
Further, translating a file into a different format also results in this information being 
lost. 



Reference may also be made to Komatsu et al "A proposal on digital watermark in 
document image communication and its application to reaUsing a signature": Electronics 
and Communications in Japan vol. 73, no.5. 31 May 1990 New York pages 22-33. 
XP 000159282. That paper discloses a technique for modifying images in such a way 
that the modified image carries hidden information. However, the modification is 
comipted if the image is manipulated: like a conventional watermark, it is designed to 
be corrupted or absent if the image is corrupted. Hence, it is of little practical benefit 
since unauthorised users of images can readily destroy the coded information by 
performing quite ordinary image manipulations, such as cropping and small rotations 
(e.g. rotations of plus or minus 1 degree needed in order to accurately set the horizon in 
35 an image). 
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Reference may also be made to EP 0551016 lo Canon KK. which discloses a system 
for manipulating the position of dots forming a photocopy. The relative positions of the 
dots code for panicular infonmation. There is no modification however of a digital data 
work as such. 

The practical requirements for a working system capable of embedding copyright 
information into a digital work are demanding: 

1. the system must be reasonably rapid and not memory intensive; 

2. the modifications which code for the additional information must not be 
readily perceptible; 

3. the modifications must be sufficiently robust to withstand the manipulations 
ordinarily applied to those data woks (e.g. in the case of digital images, 
cropping and small rotations as described above); 

4. the modifications must not be readily detectable or removable by any 
unauthorised user; 

5. the modifications must be reUably detectable without reference to the original 
data work. 

These requirements are met by the present invention. 
Statement of the invention 

In accordance with the present invention, a method of manipulating a digital data work, 
made up of a number of data elements, to include additional data descriptive of that 
digital data work, comprises the steps of:- 

dividing the whole or pan of the work into a pattern of constituent parts, each 
constituent pan consisting of a set of data elements and each set of data elements having 
a measurable characteristic; 

selecting a particular constituent part; 

modifying some or all of the set of data elements of that parricular constituent 
pan according to a given set of rules such that the measurable characteristic of that set 
is different from the measurable characteristic of the corresponding unmodified set of 
data elements, or other sets in other constituent pans, 

wherein the difference is detectable, even after the work has undergone 
alterations which are of at least one kind of the alterations ordinarily applied to such 
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works, if the pattern of the constituent parts and the nature of the measurable 
characteristic are known, but is not otherwise readily detectable; 

and wherein the modification codes for the additional data descriptive of that 
digital data work. 



10 



Hence, the essence of the invention is to superimpose a selected pattern, generated by a 
given set of rules, on sets of data elements of the work thereby to modify the sets. The 
pattern may be a repeated pattern, although this is not essential. The invention can be 
conceptualised in terms of noise: all digital information has a noise element. This 
should be imperceptible. The present invention can be thought of as organising this 
noise into regular patterns. The patterns themselves can contain information. 

Where the work is an image, then the modification is. in one embodiment. 

15 superimposed on all pixels of the image, with the possible exception of those areas 
where such a pattern would be readily discernible to the ordinary viewer. The panem or 
template may. for example, be the rows of the image and the modification may be the 
addition of +1 to every pixel in selected rows and the addition of -1 to every pixel in 
other selected rows. This modification produces only a slight change in the values 

20 describing any given pixel; however, because the pattern is applied across much or 
indeed preferably all of the image, the total information impaned can be considerable. 
The presence of the pattern can be detected by anyone who knows what pattern to look 
for, that user can then quantitatively determine the aggregate of aU the small imposed 
changes if the nanire of the measurable characteristic is known; statistical methods then 

25 make it possible to assess which information is significant and which may be 
disregarded as lying within the bounds of normal variation. 

In the example above of +1 or -1 being added to pixel values, the difference between 
the mean value of the set of pixels which were increased by one and the mean value of 
30 the set whose values were decreased by one would be greater than a value which could 
be calculated as the maximum attainable from an image whose elements had not been 
modified in the specified manner, hence the modified image can be thought of as having 
been marked. Anyone who duplicates the modified image wiU generate an image that is 
marked in this way; hence, the provenance of the duplicate can be established. 



35 



The mere presence of data elements modified in this way may constitute the additional 
data; i.e. there is no texnial information per se hidden within the digital data work. 
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Instead, the presence of manipulated sets of data elements acts as an indicator that the 
work is, for example, a copyright work which cannot be reproduced without specific 
permission from the right holder. This can be likened to giving the digital data work a 
'fingerprint'. 

5 

Funher, in another preferred embodiment, the step of modification incorporates 
addidonal data into the work which is more explicitly descriptive of the digital data 
work. 

10 Typically, a copyright message or more detailed historical information broadly 
penaining to the copyright in the digital data work (for example, date of creation, 
idendty of creator etc.), can be hidden within the digital data work in a manner that is 
not readily detectable and therefore does not discemibly alter the digital data work. 
Being able to hide such data within a work clearly also has attractions to the non- 
15 commercial user as well: for example, many cameras today have the facility to imprint a 
date on an image. This has the disadvantage of defacing the image. With this 
embodiment of the present invention implemented into a digital camera, the 
photographer can hide not only date informadon but other data too (for example, the 
names of those photographed; the place of the photograph) into each digital image with 
20 no appreciable effect on the image itself. 

Hence, in such an embodiment, the actual data content of the manipulated sets of data 
elements may code for particular textual information penaining to the copyright status 
of the work. In this way, a copyright related code number that would be hidden to 
25 persons, for example, viewing a digitised image, can be detected if one knows the 
particular paaem as defined above and the nature of the measurable characteristic. 

The pattern of constituent parts preferably does not form pan of a continuous sequence 
throughout the work. In many circumstances, it may be preferable to have a 

30 permutation algorithm to generate a pancm which distributes in a complex fashion, in 
either time or space, the constiment parts throughout the work. This may be particularly 
useful where there is a need, as there will be in most applications, to conceal the 
required pattern in order to prevent the system being cracked. Preferably also, the 
modification step itself is a function of the data content of the additional textual data to 

35 be included within the work. 
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In a preferred embodiment, a secret key is assigned to each user. An algorithm can be 
derived from that key to generate a permutation. That derivation can be achieved in a 
number of differem ways which wiU be apparent to the ordinary, skilled cryptographer. 
The permutation can be applied to the binary number sequence representing a message 
to be hidden into the data woric: this generates a permutated pattern which contains the 
message, the message being readable only to one who knows the nature of the 
permutation, i.e. the secret key. The permutated panem is then imposed repeatedly over 
the entire original data work. i.e. all pixels. The use of carefully calculated 
permutations resolves two otherwise conflicting demands on the organisation of the 
"noise" in a data work into patterns. The first demand is the need for complexity to 
avoid easy removal and to avoid visible artefacts on images. However, the complexity 
cannot be too great since that might lead to prohibitively long detection times, especially 
where the work is an image and the image is cropped or rotated. In the presem 
invention, those conflicting demands are resolved by the use of a simple underlying 
pattern which is made substantially more complex by the use of carefully calculated 
permutations. These permutations both minimise the observable pattern effects 3nd 
greaUy simplify the search and detection process. Further, the number of permuta 
can be very large. For example, with a message only 10 bits long, the numb- 
permutadons is 10! (i.e. 3,268.800). Hence, there is little difficulty in providing us : 
with unique keys. 

In another embodiment, two orthogonal permutations can be applied to code for two 
different messages. Typically, the first message can identify a photographic agency or 
library and be derived using a public key. The second message, identifying the 
copyright owner and details of the work itself, can be derived using the secret key. 

The pennutated pattern may exist as a sequence in time, for example where the digital 
data work is an audio work. In addi- .n, it may occur as a panem of locations that are 
defined by their spatial relationship.'; to one another. This may arise where the digital 
data work is an image [as in the exan 'les given above]. The panem may also exist as a 
combination of temporal and spac-: equences or patterns, for example where the 
digital data work is an audio-visual w. such as a television program or a film. 

The data elements may be the discrete or basic units of digital information and the 
characteristics may be the values of those units of digital information or statistical 
measures related to such values. For example, where the digital data work is an audio 
work, the measurable characteristic may be the values of the quantised amplitude levels 
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25 



30 



associated with each successive time period. If the digital data work is a digital image, 
then the data elements may be the pixels and the characteristics may be the pixel values, 
or staiisrical measures related to those values, as in the examples above. 

More generally, the step of modifying the data elements may only occur if the original 
and modified data elements differ by no more than a defined tolerance. This ensures 
that the manipulation of the digital data work does not alter the image beyond tolerance 
limits, hence ensuring that the manipulation is not readily discernible. Funher. the 
extent of the modification can be adapted to the level of noise of the work: in noisy 
regions in a work, larger changes are necessary, whereas in smoother regions of a 
work, smaller changes are required. 



In a yet funher aspect of the present invention, there is provided a method of reading a 
digital data work, made up of a number of data elements, comprising the steps of 
15 analysing the digital data work for a pre-determined pattern of constituent pans and 
detennining if a measurable characteristic of data elements in a panicular constituent 
pan differs from that expected. 

In addition, in another aspect, there is provided apparatus for manipulating a digital data 
20 work to include additional data, operable to perfonn the methods described above. 



Detailed Description 



The detailed description that follows is in respect of an embodiment of the invention 
that relates to manipulating the digital data of a colour digital image. 



The present embodiment is implemented in an apparatus, refencd to as DIP (Digital 
Image Protection) which [1] alters digital images by selectively modifying the pixels in 
the image and [2] acts as a detector by scanning images for previously perfomied 
35 modifications. One purpose of DIP is to hide (i.e. "fingerprint") text infomiation in the 
image in such a way that the legal owner of the copyright in the image can prove his^er 
ownership of the image even after severe modifications of the image. 
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Each time the user runs the program to place such hidden information within an image, 
a counter in DIP is incremented by one: when a pre-set number of njns have been 
made, no funher runs are possible until the user has obtained a re-fresh. The counter 
may be incorporated within a "dongle", conventionally used to prevent copying of 
software programs and used also as an access control device. The re-fresh may be 
achieved by the user purchasing a new "dongle". Alternatively, the counter may be 
linked to an encryption program that enables further usage when a given code word is 
entered via a connected keyboard into the DIP apparatus. That code word is unique to 
that particular DIP and/or connected "dongle" and can be obtained by the user 
telephoning its DIP supplier, who will have recorded the various codes. In this way, 
die DIP supplier ensures continuing revenues on a usage basis. 

The permutation process is fundamental to one embodiment of the invention, namely 
15 the embodiment that enables messages to be coded into digital data works. A simple 
exemplification of the development of the permutation method now follows. The 
generalised version of this method, initially in a slightly simplified form, is then 
presented in mathematical notation. The conceptual basis for the permutation technique 
is detailed below. 



20 



A simple code seque nce with no t)ennutarion<; 



Suppose a code is to be added to an original image which is 60 X 60 pixels in size and 
thai code is in the form of six numbers a, b, c, d, e, all of which fall within the 
25 range -2 to +2. This code could be added to groups of six adjacent pixels, so that the 
code formed the sequence abcdefabcdefabcdef..... 

However, this sequence is so regular it might readily be seen by the human eye. Also, 
the code is so obvious it is readily detectable by a hacker. Nevertheless, continuing 
30 with this example for illustrative convenience, imagine that the original pixel values of 
the image are : 

34 49 38 41 77 70 68 63 ( jp to the 60th column) 

( for all rows up to the 60th row) 

35 then the coded image will have the values: 



34+a 49+b 38+c 41+d 77-f-e 70+f 68+a 63-t-b (..up to the 60th column) 
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( for all rows up to the 60th row) 

We can then define a set of all those pixels that have had a added to them as the set A: 
and all those that have had b added to them as the set and similarly for sets C, D, E 
5 and F. 

S appose the mean pixel value for the whole image before the coding is applied is ICX). 
Because the numbers of elements in each of the sets A, B, C, D, E and F are large, 
the mean value of each set will be quite close to 100 also. For example, the mean values 
10 might be: 

100.3 99.6 100.1 100.2 99.9 99.8 respectively 

Suppose that we set the values for a, b, c, d, e, f as follows: 
2-111-2-1 
15 Then the mean values for each set are: 

102.3 98.6 101.1 101.2 97.9 98.8 
If we round the numbers to the nearest whole number, we obtain: 

102 99 101 102 98 99 
If we subtract 100 from each of these, we find the original code: 
20 2 -1 1 2 -2 -1 

This simple example illustrates how the coded message can be input and recovered. 
Statistical test can also be used to determine if a code is present. Statistical tests are 
always needed because the limits of possible deviations of the mean value of sets 
A,Bv— must be calculated in order to be sure that results arc not caused by random 
25 fluctuations. 

PgnmutariQn mctfipd? 

The code abcdefabcdefabcdef is so regular it might readily be seen by the 

30 human eye. Also, the code is so obvious it is readily detectable by a hacker. The 
permutation technique effectively addresses both concerns. 

A permutation is simply a rc-ordcring of numbers. Using a standard notation, we can 
represent the straight forward order abcdef with the code PO, We can permute this 
35 sequence so that the first element is shifted to the third, the second to the sixth, the third 
to the fifth, the fourth to the first, the fifth to the second and the sixth to the founh. We 
can represent this with the simple notation 



wo 96/27259 

10 

P = 1 2 3 4 5 6 
3 6 5 1 2 4 

5 so that Pl{a,b.c,d,e,f} = {d,e,a,f,c,b} 

We can now apply the same permutation to the new set, so that 

P2{a,b,c,d,e,f} = P{d,e,a,f,c,b}= P{P{a,b,c,d,e,f}) = {f,c,d,b,a,e} 

10 This yields the following six permutadons: 

PO = {a,b,c,d,e,f} 

PI = {d,e,a,f,c,b} 

P2 = {f,c,d,b,a,e} 

15 P3 = {b,a,f,e,d,c} 

P4 = {e,d,b,c,f,a} 

P5 = {c,f,e,a,b,d} 

P6 = {a,b»c,d,e,f} = PO 

20 In the first example above, the code was added in the simplest way possible, i.e. 
abcdefabcdefabcdef 

The permutation technique allows us to add the following sequence instead: 
abcdef deafcb fcdbae bafedc edbcfa cfeabd .... 

This sequence is bodi far less noticeable and also less corruptible. Since the detector 
25 knows the permutation to look for, it will be able to reconstruct the sets A, B, C, D, 
E, F. 

The commutative permutation technique is a versatile one and leads to images carrying 
the code being able to retain sufficient code information even after manipulations to the 

30 image such as cropping. For example, before the image has been cropped, suppose that 
the first pixel had the value a added to it. After cropping, we do not know which part of 
the sequence stans at the first pixel. In the example given above, there are 6 sets of 6 
elements each, i.e. 36 elements in total. However, the detector does not have to try each 
of the 36 elements as possible stan elements. In fact, it need look only at the first 6 

35 elcnoents. In practice, there is an even greater saving, since instead of there being 6 sets 
of 6 elements each, tiicrc are typically 30 sets of 30 elements each. 
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Suppose that the image has been cropped so that the pattern added to it is as follows: 
fcb fcdbae bafedc edbcfa cfeadb abcdef deafcb fcdbae bafedc... 
The detector will not know that the image has been cropped and will therefore assume 
that the first 6 elements form the first set. It will see the above sequence as: 
5 fcbfcd baebaf edcedb cfacfe adbabc defdea fcbfcd baebaf cdc... 

If the sequence fcbfcd was genuinely the first set, then the next set ought to be 
fcfdbc, since that is the first permutation of it. But in fact the next set is baebaf. 
Because of this mismatch, the detector knows that the sequence does not in fact stan at 

10 fcbfcd, i.e. the detector knows that the image must have been cropped. If it then 
moves on to the next letter, the first c, the same problem arises. The same problem also 
arises with the next letter, b. However, on moving to the next element, the founh, i.e. 
the second letter f, the predicted subsequent permutations in fact agree with those 
actuaUy present in the image. Hence the detector can rapidly determine where the true 

15 Stan of the sequence is by looking only at the first six elements, even though the image 
has been cropped. 

Because the same permutation is applied to conven each of the sets PO, PI, P2, P3, 
P4, P5 into each of the others, the detector still does not know whedier the set fcdbae 
20 is P2 or one of the other sets. This can however be solved by saying that the element a 
always has a particular value (2 in the example above) and that no other element has that 
value. Once the set fcdbae has been found, the unique value a will be found in the 
fifth location. This therefore shows that the set is P2. Having defined P2, all the other 
sets can be defined in the right order. 

25 

Applviny the pfrmutarion t q a real ima^ e 

To make the pattern more compact and also to go funher in avoiding anefacts produced 
by the fingerprint, it is formed in rectangular ratiier than linear arrays. The permutations 
30 defined above will actually be imprinted as: 



abc 


baf 


abc baf 


abc 


baf.„» 


def 


dec 


def dec 


def 


dec... 


fed 


cfe 


fed cfe 


fed 




bae 


abd 


bae abd 


bae 


abd...* 


edb 


dea 


edb dea 


edb 


dea... 


cfa 


fcb 


cfa fcb 


cfa 


fcb.... 



40 
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abc baf 
def dec 



abc baf 
def dec 



abc baf .. 
def dec .. 



This can be represented as follows: 

5 

PO P3 PO P3 PO P3 

P2 PS P2 P5 PO P5 

P4 PI P4 PI P4 PI 

PO P3 PO P3 PO P3 

10 P2 P5 P2 P5 PO P5 

P4 PI P4 PI P4 PI 



The detection operates as described above, with for example, the same process being 
applied to detect cropping. It should be noted that as readily available computing 
15 power increases, the detector can use more sophisticated means of detection and can 
thus cope with greater levels of image degradation and more elaborate transformations 
in a reasonable time. 



In the example above, a code with only 6 elements was discussed. Suppose we need to 
20 deal with a code with many more elements. We would like to arrange them in the 
rectangular array described above and avoid too much regularity. We are therefore 
interested in any number n which is a product of a pair of co-primes, r and s (in the 
example above, n is 6, the product of the co-prime pair 2 and 3). The number of 
permutations is very large so that it is difficult to extract the message without a 
25 knowledge of the key and the extraction method. 

Generalisation of the Permutation M^^ hnH 

The generalisation of the above example will now be described, initially in a slightly 
30 simplified form. This generalisation describes a linear permutarion scheme in which 
there arc offsets applied to each image line. Some of the general concepts put forward 
above are repeated, but in a sUghtly different (and in pans more mathematical) manner. 

In this example, the pattern which DIP imposes upon such an image may be regarded 
35 as a template covering a set of pixels; the template is repeatedly placed upon the image. 
Any chosen clement of the template will appear in many positions on the image. 
Corresponding to any element of the template is a set of pixels, each corresponding to 
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an eiement of the template. If the shape and size of the template are appropriately 
chosen then the sets into which the image is divided will be nghdy interlaced. This will 
mean that the average values of pixels in one set should not differ subsianrially from the 
average values in another set. If, however, a value is added to every member of one of 
5 these sets then the average value will show a marked deviation from that of any other 
set This difference consututes a recoverable piece of information. 

In more mathematical terms, the average values of the sets of values into which the 
image is sub-divided will have a known statistical distribution. The parameters of this 
10 distriburion can easily be calculated in advance. TTiis enables any exceprional values 
such as those arising from imposition of a regular pattern to be detected. It is also 
possible to calculate the relationship between the number of elements in a panem, the 
magnimde of the imposed alteration in data, the size of the image and the detectability of 
a pattern. Thus the type of panem appropriate for any given situation can be selected. 

15 

As in the previous examples, the imposed pattern provides a means of storing a 
message of some son in an image. The length of that message is restricted by the 
consideration above, namely the need not to subdivide the image into sets of too small a 
size. However, too shon a repeated pattern would ease the problem of detection for 
20 someone who did not have xhc encryption key used in the original marking process (see 
below). For this reason, the panem is again pcrmutatcd throughout the image according 
to a rule derived from the encryption key. 

In one embodiment, the user selects an alphanumeric encryption key K{ki, 

25 ^^2 kfi} and message M{nii, ni2 mp}. The number, p. of terms in the 

message is governed by the minimum size of an image in which the fingerprint may be 
detected. 

Encryption process E convens K into a set of q-1 permutations P{pi, p2 Pq- 

30 1} and a set of integer offsets 0[offi, off2, offs), and also convens M into 

a set of integers N{ni, n2 nr}, some positive and some negative. 

A set of q permutations of N are then generated according to the scheme: - 

35 Ni = PI (N) 

N2 = P2 (Ni) 
N3 = P3 (N2) 
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I.e.: Nq.i = pq.i (N(q.2)) 

^' '^l' ^^2, Nq.i are then concatenated to produce a single extended set 

5 EN{en i, en2, enqr}. 

The values in EN are then added in succession to the values describing the pixels along 
a Une of the image. The same values are then added to the succeeding line with an offset 
chosen successively from the set O. 



10 



20 



Schematically, this can be represented as: 

for(row = 0; row < imageheight; row ++) 
{ ' 

15 row_offset = off (row % s) (a % b = remainder when a is 

divided by b) 

for (pixel = 0; pixel < imagewidth ; pixel ++) 

{ 

pixel offset = (row offset + pixel) % qr; 
pattern_value = en(pixel % qr); 
pixel_value = pixel value + pattern value; 

} 

} 

25 The fingerprint thus exists throughout the image and hence operations such as 
cropping, rotating and scaUng will not affect its presence. The addition of patterns, 
excepting those of identical frequencies, will not disguise the fingerprint. Knowledge 
of the required destructive frequencies requires knowledge of the encryption process E. 

30 The method DIP uses to detect the presence of fingerprints will now be described. 

Detection requires knowledge of the encryption key K. As above, the set of 
permutations P and offsets O are generated from this key K. The detector then 

calculates a set of equivalent pixels for the image as follows: The set S{1,2 J p} 

is permuted according to the scheme :- 



35 



51 = PI (S) 

52 = P2 (Si) 
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S3 = P3 (S2) 

i.e.: Sq-l = pq-i (S(q.2)) 

5 S, Si, S2i Sq-i are then concatenated to produce a single extended set 

ES{esi, es2y esnq}, where each of the elements es is an integer in the 

range 1 to p. 

This set of values is attached one to each pixel across a line of the image. The detector 
10 takes the first line of the image and ascribes each pixel value to one of p equivalent sets 

Q {qii q2. q3 qp} as indicated below. The total value, Tq, of the pixels in 

each set is then found. 

Schematically 

15 for(row = 0; row < imageheight; row ++) 
{ 

row offset = off (row % s) 

for (pixel = 0; pixel < imagewidth ; pixel ++) 

{ 

20 pixel^offset = (row offset + pixel) % qr; 

equiv^set = espixel_offest; 
Tequiv_set = Tequiv set + pixel_value; 

} 

} 

25 

This summation produces a set of p totals Tq. By applying a Chi squared test it can be 
determined whether or not these totals could have arisen from data which had not been 
modified according to the selected form of encryption. This test may thus confirm the 
existence of a message coded by the use of key K, If the message is thus found to exist 
30 it may be deciphered as follows. The mean value Tniean of the set of total Tq is 
found. The standard deviation of the totals is calculated from knowledge of the standard 
deviation of the original data and the number of pixel values in the image. From this an 
upper limit U and lower limit L of expected values of Tq are calculated. Only if a 
panem has been imposed on the image will values of Tq lie outside the range (L,U)- 

35 

The message is deciphered in binary form using the rule for each total in rum:- 
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15 



16 



for(index = 0; index < p;index++) 



{ 



iUT index > U) 

{ 

niindex = +1; 

} 

else 

{ 

^f(Tindex < L) 

»"index = -1; 



ise 



index is not defined 



20 



25 



30 



If all values of m are defined then the message is valid. 

Transfcrnanons of an image mean that the above method must be appUed with different 
orieniauons, starting locations and scaling factors. However, the nature of the method 
will remain substantially unchanged. 

To render the above scheme equivalent to the original simple example, and for the 

reasons elucidated in that example, each of the permuted sets N^. n2. n3 is 

arranged in a rectangle rather than in linear fashion. These rectangles are then arranged 
in a fashion analagous to that described in the example. 



Orientation marW^ 



35 



One of the problems of precisely defined patterns being imposed on an image is that 
resizing or rotation of the image renders the detection very difficult and in general 
requires that repeated searches with different values of three parameters be performed. 
To overcome this problem, the image can be printed with orientation markers. These 
markers are in the form of stripes at a chosen angle. To avoid being clearly visible the 
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Stripes are not solid. Instead, pixels forming pan of the stripes are aimed on randomly. 
This leads to the stripe image not being trivially removable. 

The method of detection of the stripes is to search the image for regularly occurring 
frequencies which correspond to the width of the stripes. The image is then rotated 
through small amounts and in each position the presence of a doniinating frequency is 
sought. The angle at which such a frequency occurs indicates the angle of rotation, the 
value of the frequency indicates the scaling of the image if the frequency of the original 
is known. 

Aitemauvely, dominating frequencies may be sought in two onhogonal directions and 
the same information derived together with information about any anamorphism. The 
frequency can be sought by the usual method of correlating the image with a function of 
known frequency, or by correlating two or more separate pans of the image. 
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10 



Claims 



I . A method of manipulating a digital data work, made up of a number of data 
elements, to include additional data descriptive of that digital data work, comprising the 
steps of:- 

dividing the whole or pan of the work into a pattern of constituent parts, each 
constituent pan consisting of a set of data elements and each set of data elements having 
a measurable characteristic; 

selecting a particular constituent pan; 

modifying some or all of the set of data elements of that panicular constituent 
pan according to a given set of niles such that the measurable characteristic of that set 
15 is different from the measurable characteristic of the corresponding unmodified set of 
data elements, or other sets in other constituent pans, 

wherein the difference is detectable, even after the work has undergone 
alterations which are of at least one kind of the alterations ordinarily applied to such 
works, if the pattern of the constituent pans and the nature of the measurable 
20 characteristic are known, but is not otherwise readily detectable; 

and wherein the modification codes for the additional data descriptive of that 
digital data work. 



2 . The mctiiod of Claim 1 wherein the actual data content of the manipulated 
of data elements codes for the additional data. 

3 . The method of Claim 1 or 2 comprising the funher steps of: 
[1] generating a secret key; 

[2] generating a permutation using that secret key; 

[3] generating a binary number sequence representing the additional data 

descriptive of that data work to be hidden into the data work: 

[4] applying the permutation to the binary number sequence to generate a 

permutated pattern; 

[5] imposing the permutated pattern repeatedly over the entire original data 
work. 



i 
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4. The method of claim 3 wherein the pemiutated pattern is imposed as a linear array. 

5. The method of claim 3 wherein the permutated pattern is imposed as a rectangular 
array. 

5 

6. The method of claim 4 o 5 wherein the additional data descriptive of that digital data 
work is consists of two messages, one associated with a first permutation, the second 
associated with a second permutation, the permutations being onhogonal. 

10 7. The method of any preceding claim comprising the funher step of imposing 
orientation markers upon the work. 

8. The method of any preceding claim wherein the extent of the modifications at any 
particular region of the work depends upon the noise level in that region. 

15 

9 . An apparatus adapted to manipulate a digital data work to include additional data 
descriptive of that digital data work, the work being made up of a number of data 
elements, and being divided into a pattern of constituent parts, each constituent pan 

20 consisting of a set of data elements and each set of data elements having a measurable 
characteristic; consisting of: 

[1] a data store for storing data representing the measurable characteristics; 
[2] a processor adapted to modify some or ail of the stored data in the data store 
representing the set of data elements of that particular constituent pan according to a 
25 given set of rules such that the measurable characteristic of that set is different from the 
measurable characteristic of the correspondimg unmodified set of data elements, or other 
sets in other constituent pans; 

wherein the difference is detectable, even after the work has undergone 
alterations which are of at least one kind of the alterations ordinarily applied to such 
30 works, if the pattern of the consriment pans is known and the nature of the measurable 
characteristic is known, but is not otherwise readily detectable, and the modification 
codes for the additional data descriptive of that digital data work. 



INTERNATIONAL SEARCH REPORT 



(nle jnal Appiicaaon No 

PCT/GB 96/0G491 



A. CXASSIFICATION Of- SUBJECT MATTER 

IPC 6 H04NI/32 



According to Intemationai Patent Oa.^qficaQon ((PQ or to both nationaJ clasxificaaon and IPC 



B. FIELDS SEARCHED 



Minimum documenUQon searched (ctassil'icaaon system followed by classification symbols) 

IPC 6 H04N 



DocumentaQon searched other than minimum documenuoon to the extent that such documents are included in the fields searched 



Electronic data base coasulted dunng the mtemaaonal search (name of data base and, where pracacal, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ' CiUtion of document, with indicauon. where appropnaie, of the relevant pa.ssages 



Relevant to claim No. 



A.P 
A 



ELECTRONICS AND COMMUNICATIONS IN JAPAN. 
PART 1, 

vol. 73, no. 5, May 1990, NEW YORK, US. 

pages 22-33, XP000159282 

KOMATSU, N. ET AL: "A Proposal on Digital 

Watermark in Document Image Connunication 

and Its Application to Realizing a 

Signature" 

cited in the application 
see paragraph 4; figures 5.6 

WO, A, 95 20291 (MOR LTD) 27 July 1995 
see the whole document 

EP,A,0 551 016 (CANON KK) 14 July 1993 
cited in the application 
see column 3, line 44 - coluim 6, line 11; 
figure 1 



1.9 



1.9 
1.9 



□ 



Further documents are listed m the continuation of box C. 



P&tenl family members are listed tn annex. 



' Spcaal categories of ated documents : 

'A' document defining the general state of the art which is not 

considered to be of particular relevance 
'E* earlier document but published on or after the mtemaaonal 

fding dau 

'L' document which may throw doubts on pnonty dairies) or 
which is ated to esuUtsh the publication date of another 
auaon or other speaal reason (as specified) 

'O' document refemng to an oral disclosure, use, exhibition or 
other means 

'P' document published pnor to the international filing date but 
taier than the pnonty date claimed 



'T* later document published aAer the mtemattonal filing dau 
or pnonty date and not in conflict with the applicabon but 
ated to understand the pnnciple or theory underlying the 
invention 

'X' doctonent of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an invenQve step when the document is taken alone 

'Y' doctxnwm of particular relevance; the d aimed invention 
cannot be considered to involve an invenQve step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
m the arL 

document member of the same patent fairuly 



Date of the actual completion of the international search 



20 June 1996 



Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Pauntlaan 2 
NL • 2280 HV Rj|swiik 
Td. ( ^ 31-70) 340-2040. Tx. 31 651 epo nl. 
Fax: 31. 70) 340-3016 



Date of mailing of the intennational search report 



I 8. 07. 96 



Authonzed officer 



Revellio» H.S. 



Focm per. ISA/210 (mcoa4 thMl) (July 1993} 



INTl^NATIONAL SEARCH REPORT 

..itormation on paienl (axmty mcmbcn 



Patent documeni 
cited in search report 



Publication 
date 



[nie: >aal AppJicaoan No 

PCT/GB 96/0G491 



Patent family 
member(s) 



Publication 
date 



WO-A-9520291 



27-07-95 



AU-B- 



1422895 



08-08-95 



EP-A-0551016 14-07-93 CA-A- 2086472 07-07-93 

JP-A- 5301380 16-11-93 
US-A- 5457540 10-10-95 



Form PCT-ISA.JIO (pMat ftmdf mam) (July 1992) 



